Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters
Identifieur interne : 000E66 ( Main/Exploration ); précédent : 000E65; suivant : 000E67Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters
Auteurs : Stéphane Vialle [France] ; Sylvain Contassot-Vivier [France]Source :
English descriptors
- mix :
Abstract
This chapter proposes a study of the optimization process of parallelapplications to be run on modern architectures (multi-core CPU nodes with GPUs).Different optimization schemes are proposed for overlapping computations withcommunications, and for computation kernels.Development methodologies are introduced to obtain different optimizationdegrees and specific criteria are defined to help developers find the mostsuited degree of optimization according to the considered application andparallel system. According to our experience in industrial collaborations, weanalyze both performance and code complexity increase. This last point is animportant issue, especially in the industry, as it directly impacts developmentand maintenance costs.Complete experiments are performed to evaluate the different variants of abenchmark application that consists in a dense matrix product. In thoseexperiments, different runtime parameters and cluster configurations are tested.Then, the results are analyzed to evaluate the interest of the differentoptimization degrees as well as to validate the interest of the proposedoptimization methodology.
Url:
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: 003991
- to stream Hal, to step Curation: 003991
- to stream Hal, to step Checkpoint: 000D10
- to stream Main, to step Merge: 000E62
- to stream Main, to step Curation: 000E66
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters</title><author><name sortKey="Vialle, Stephane" sort="Vialle, Stephane" uniqKey="Vialle S" first="Stéphane" last="Vialle">Stéphane Vialle</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-26305" status="VALID"><orgName>SUPELEC-Campus Metz</orgName><desc><address><addrLine>2 rue Edouard Belin 57070 Metz</addrLine><country key="FR"></country></address><ref type="url">http://www.metz.supelec.fr/metz/</ref></desc><listRelation><relation active="#struct-300812" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300812" type="direct"><org type="institution" xml:id="struct-300812" status="VALID"><orgName>SUPELEC</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Contassot Vivier, Sylvain" sort="Contassot Vivier, Sylvain" uniqKey="Contassot Vivier S" first="Sylvain" last="Contassot-Vivier">Sylvain Contassot-Vivier</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-205117" status="VALID"><idno type="RNSR">200718299P</idno><orgName>Algorithms for the Grid</orgName><orgName type="acronym">ALGORILLE</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/algorille</ref></desc><listRelation><relation active="#struct-129671" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-423085" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno><orgName>INRIA Nancy - Grand Est</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/nancy</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-423085" type="direct"><org type="department" xml:id="struct-423085" status="VALID"><orgName>Department of Networks, Systems and Services</orgName><orgName type="acronym">LORIA - NSS</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/networks-systems-and-services</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-01101225</idno><idno type="halId">hal-01101225</idno><idno type="halUri">https://hal.inria.fr/hal-01101225</idno><idno type="url">https://hal.inria.fr/hal-01101225</idno><date when="2014">2014</date><idno type="wicri:Area/Hal/Corpus">003991</idno><idno type="wicri:Area/Hal/Curation">003991</idno><idno type="wicri:Area/Hal/Checkpoint">000D10</idno><idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000D10</idno><idno type="wicri:Area/Main/Merge">000E62</idno><idno type="wicri:Area/Main/Curation">000E66</idno><idno type="wicri:Area/Main/Exploration">000E66</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters</title><author><name sortKey="Vialle, Stephane" sort="Vialle, Stephane" uniqKey="Vialle S" first="Stéphane" last="Vialle">Stéphane Vialle</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-26305" status="VALID"><orgName>SUPELEC-Campus Metz</orgName><desc><address><addrLine>2 rue Edouard Belin 57070 Metz</addrLine><country key="FR"></country></address><ref type="url">http://www.metz.supelec.fr/metz/</ref></desc><listRelation><relation active="#struct-300812" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-300812" type="direct"><org type="institution" xml:id="struct-300812" status="VALID"><orgName>SUPELEC</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Contassot Vivier, Sylvain" sort="Contassot Vivier, Sylvain" uniqKey="Contassot Vivier S" first="Sylvain" last="Contassot-Vivier">Sylvain Contassot-Vivier</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-205117" status="VALID"><idno type="RNSR">200718299P</idno><orgName>Algorithms for the Grid</orgName><orgName type="acronym">ALGORILLE</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.inria.fr/equipes/algorille</ref></desc><listRelation><relation active="#struct-129671" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-423085" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno><orgName>INRIA Nancy - Grand Est</orgName><desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/nancy</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-423085" type="direct"><org type="department" xml:id="struct-423085" status="VALID"><orgName>Department of Networks, Systems and Services</orgName><orgName type="acronym">LORIA - NSS</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/networks-systems-and-services</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term>communication-computation overlapping</term><term>computing kernel optimization</term><term>deployment.</term><term>message passing</term><term>multithreading on multicore</term><term>vectorization on GPU</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">This chapter proposes a study of the optimization process of parallelapplications to be run on modern architectures (multi-core CPU nodes with GPUs).Different optimization schemes are proposed for overlapping computations withcommunications, and for computation kernels.Development methodologies are introduced to obtain different optimizationdegrees and specific criteria are defined to help developers find the mostsuited degree of optimization according to the considered application andparallel system. According to our experience in industrial collaborations, weanalyze both performance and code complexity increase. This last point is animportant issue, especially in the industry, as it directly impacts developmentand maintenance costs.Complete experiments are performed to evaluate the different variants of abenchmark application that consists in a dense matrix product. In thoseexperiments, different runtime parameters and cluster configurations are tested.Then, the results are analyzed to evaluate the interest of the differentoptimization degrees as well as to validate the interest of the proposedoptimization methodology.</div></front></TEI><affiliations><list><country><li>France</li></country><region><li>Grand Est</li><li>Lorraine (région)</li></region><settlement><li>Metz</li><li>Nancy</li></settlement><orgName><li>Université de Lorraine</li></orgName></list><tree><country name="France"><noRegion><name sortKey="Vialle, Stephane" sort="Vialle, Stephane" uniqKey="Vialle S" first="Stéphane" last="Vialle">Stéphane Vialle</name></noRegion><name sortKey="Contassot Vivier, Sylvain" sort="Contassot Vivier, Sylvain" uniqKey="Contassot Vivier S" first="Sylvain" last="Contassot-Vivier">Sylvain Contassot-Vivier</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000E66 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000E66 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Exploration
|type= RBID
|clé= Hal:hal-01101225
|texte= Optimization methodology for Parallel Programming of Homogeneous or Hybrid Clusters
}}
| This area was generated with Dilib version V0.6.33. |  |